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Abstract 

In Part I of this paper, [1], we have developed a novel L\ adaptive control architecture that 
enables fast adaptation and leads to uniformly bounded transient and asymptotic tracking 
for system's both signals, input and output, simultaneously. In this paper, we derive the sta- 
bility margins of L\ adaptive control architecture, including time-delay and gain margins 
in the presence of time-varying bounded disturbance. Simulations verify the theoretical 
findings. 

1 Introduction 

Adaptive control schemes have proven to be extremely useful in a number of flight 
tests for recovering the nominal performance in the presence of modeling and en- 
vironmental uncertainties (see [2] and references therein). A major challenge in 
analysis of these systems is determining its stability margins dependent upon the 
adaptation gain. Today it largely relies on the numerical evidence provided by 
Monte-Carlo schemes. It has been observed that increasing the adaptation gain 
leads to improved tracking performance, but results in high-frequency oscillations 
in the control signal and reduces the system's tolerance to the time-delay in the 
control and the sensor channels. 

In the linear time invariant (LTI) systems theory, stability margins are defined 
by the gain and the phase margins. Phase margin characterizes the amount of 
additional phase lag at the gain-crossover frequency required to bring the system 
to the verge of instability. Phase margin is significant in predicting how much time- 
delay the system can endure in its input/output channels before it loses its stability. 
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^The authors are with Aerospace & Ocean Engineering, Virginia Polytechnic Institute & State 
University, Blacksburg, VA 24061-0203, e-mail: chengyu, nhovakim@vt.edu 



1 



1 Introduction 



2 



While the gain margin can be generalized for nonlinear systems, the notion of the 
phase margin cannot be extended to nonlinear systems in straightforward manner. 
Instead it is common to use sector and disk margins for nonlinear systems [3]. 
However, from practical control design perspective these notions are not as useful 
as the phase margin in the linear systems theory. In this paper, instead of the phase 
margin we introduce the notion of the time-delay margin directly for the closed- 
loop nonlinear adaptive system. Time-delay margin characterizes the maximum 
time-delay in the (sensor) channel that the closed-loop system can tolerate before 
it loses its stability. In linear systems theory this corresponds to the ratio of the 
phase margin to the cross-over frequency of its Bode plot. Similarly, the gain 
margin is the maximum open loop gain that the closed-loop system can tolerate 
before it loses its stability. 

In [4, 5], we have introduced novel L\ adaptive control architecture that has 
guaranteed transient performance. In [1], we have extended the approach to sys- 
tems with unknown time-varying parameters and bounded disturbances. In this 
paper, we derive the stability margins for the C\ adaptive control architecture 
from [1], which we specialize for unknown constant parameters and bounded time- 
varying disturbances. While the analysis of the gain-margin is relatively straight- 
forward, the analysis of its time-delay margin takes several steps. At first we in- 
troduce an equivalent linear-time invariant (LTI) system, subject to an exogenous 
input dependent upon the parameters and time trajectories of certain signals of the 
closed-loop adaptive system. We prove that with the same initial conditions in the 
presence of the same time-delay in the output channels of these two systems there 
exists at least one exogenous input such that their resulting trajectories are the same 
over the entire time-horizon. Next, we prove that for every value of the time-delay 
within the time-delay margin of this LTI system there exists a lower bound for the 
adaptive gain that renders this exogenous input bounded. 

We notice that characterization of the time-delay margin is extremely difficult 
as compared to the gain-margin analysis for nonlinear closed-loop systems. To the 
best of our knowledge there are no such results in adaptive control theory, despite 
the fact that there is a large body of well-established literature on adaptive control 
of time-delay systems. Control of time-delay systems and determining the time- 
delay margin of a closed-loop system are principally different problems, and one 
cannot be used to provide a solution for the other. On the other hand, this is not 
surprising since the time-delay margin cannot be characterized if the transient is 
not guaranteed. 

The paper is organized as follows. Section |2] states some preliminary defini- 
tions, and Section |3] gives the problem formulation. In Section |4j the C\ adaptive 
controller is presented. Stability margins, including time-delay and gain margins, 
are derived in Section|5] Results of [1] and of this paper are generalized in Section 
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[8] In section [9j simulation results are presented, while Section \W\ concludes the 
paper. The proof of the main theorem is in Appendix. 

2 Preliminaries 

In this Section, we recall some basic definitions and facts from linear systems the- 
ory, [6-8]. 

Definition 1 : For a signal = [&(*), • • • ,Cn(t)] T , t > 0, its truncated 

norm and £oo norm are defined as \\Ct\\c x = maXi=i ) .. )n (sup < T < f |&(r)|), UWc^ = 

max i= i j .. )fl (sup r > |&(t)|). 

Definition 2: The C\ gain of a stable proper single-input single-output system 
H(s) is defined as = \h(t)\dt, where h(t) is the impulse response 

of H(s), computed via the inverse Laplace transform h(t) = 7^ fa-i™ H(s)e st ds, t > 
0, in which integration is done along the vertical line x = a > in complex plane. 

Proposition: A continuous time LTI system (proper) with impulse response 
h(t) is stable if and only if f °° \h(r)\dT < 00. A proof can be found in [6] (page 
81, Theorem 3.3.2). 

Definition 3: For a stable proper m input n output system H(s) its C\ gain is 
defined as \\H(s)\\ Cl = max i= i v . )n fej=i \\ H ij( s )\\c^j , where Hij(s) is the i th 
row j th column element of H(s). 

Lemma 1 : For a stable proper multi-input multi-output (MIMO) system H(s) 
with input r(t) G IR m and output x(t) G IR n , we have \\x t \\£ x < \\H\ld IMIAx>j ^ 
0. 

Corollary 1 : For a stable proper MIMO system H(s), if the input r(t) G M m is 
bounded, then the output x(t) G IR n is also bounded as H^H/^ < ||-f^('S)|| ; c 1 ||r||/; 00 . 

Consider a linear time invariant system: x(t) = Ax(t) + bu(t), where x G IR n , 
u G M, b G IR n , A G IR nxn is Hurwitz, and assume (si - A) _1 6 is strictly 
proper and stable. Notice that it can be expressed as: (si — A)~ l b = where 

d(s) = det(sJ — A) is a n th order stable polynomial, and n(s) is a n x 1 vector 
with its i th element being a polynomial function: rij(s) = Y^=i nijS^~ l . 

Lemma 2: If (A G R nxn , 6 G IR n ) is controllable, the matrix N with its i* h row 
j th column entry is full rank. 
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Lemma 3: If (A, b) is controllable and (si — A)~ 1 b is strictly proper and stable, 
there exists c G JR n such that c T (si — A)~ l b is minimum phase with relative 
degree one, i.e. all its zeros are located in the left half plane, and its denominator 
is one order larger than its numerator. 

Also, we introduce the following notations that will be used throughout the 
paper. Let Xh(t) be the state variable of the LTI system H x (s), while Xi(t) and 
x s (t) be the input and the output signals of it. We note that for any time instant t\ 
and any fixed time-interval [t\, t^, where ti > t±, given Xh(t\) and an impulse- 
free input signal Xi(t) over [t±, t^), x s (t) is uniquely defined for t G [t\, t<i[. Let 
5bethemapx s (t)| te[tlit2 ] = S(H x (s),x h (ti),Xi(t)\ te[tut2) ). We note that S is 
continuous, if Xi(t) is impulse free. Also, x s (t) is defined over a closed interval 
[ii, t%], although xi(t) is defined over the corresponding open set \t\, ti). The 
next lemma follows from the definition of S. 

Lemma 4: Let x Q1 | t6[tlj ta] = S(H x (s), x hl , x h (t) \ te[tu x Q2 \ te[tu ta] = S(H x (s),x h2 , x i2 (t) | ie[il> t2) ). 
If Xfn = Xh 2 and x^^t) = Xi 2 (t) over [ti , t2)> then x Ql (t) = x Q2 (t) for any 
* G [*1,*2]. 

3 Problem Formulation 

Consider the following single-input single-output system dynamics: 



where x G K n is the system state vector (measurable), it G 1R is control signal, 
y G IR is the regulated output, b, c G K n are known constant vectors, A m G IR nxn 
is given Hurwitz matrix, to G IR is unknown constant with given sign, 9 G IR n 
is unknown constant vector, and a(t) G IR is a uniformly bounded time- varying 
disturbance with a uniformly bounded derivative. Without loss of generality, we 
assume 



where to UQ > uj[ > are known (conservative) upper and lower bounds, is a 
known (conservative) compact set and Ao G 1R + is a known (conservative) 
bound of a(t). We further assume that a(t) is continuously differentiable and its 
derivative is uniformly bounded, i.e. \&(t)\ < d a < 00 for any t > 0, where da- 
can be arbitrarily large as long as it is finite. 

In [1], we have considered the system in Q in the presence of time-varying 6(t) 
and have designed an adaptive controller to ensure that y(t) tracks a given bounded 



x(t) 

y{t) 




(i) 



wefi = [wio, wj, See, |<r(t)| < A , Vi>0 



(2) 
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continuous reference signal r(t) both in transient and steady state, while all other 
error signals remain bounded. The main result of [1] implies that by increasing the 
adaptation gain one can get arbitrarily close transient and asymptotic tracking of 
a desired reference system. In [1], we have also considered the particular case of 
constant 9. Here we investigate the stability margins for this latter case. 

4 £i Adaptive Controller 

In this section, we repeat the L\ adaptive control architecture for the system in 
([B that permits complete transient characterization for both u(t) and x(t), [1]. 
The elements of C\ adaptive controller are introduced next without repeating the 
proofs from [1]. 

Companion Model: The companion model is: 

k(t) = A m x(t) + b(u(t)u(t) + 9 T (t)x(t)+a(t)), 

y(t) = c T x(t) , x(0) = x , (3) 

which has the same dynamic structure as the system in (Q. Only the unknown 
parameters and the disturbance cu,9,a(t) are replaced by their adaptive estimates 

Co(t),9(t),a(t). 

Adaptive Laws: Adaptive estimates are governed by the following laws: 

§(t) = -r e Pro)(x(t)x T (t)Pb,9(t)), (4) 
&(t) = -T a Pioi(x J \t)Pb, a (t)), (5) 
Cj{t) = -T w Froi(u(t)x T (t)Pb,u(t)), (6) 

where x(t) = x(t) — x(t) is the error signal between the state of the system and 
the companion model, P is the solution of the algebraic equation A^P + PA m = 
-Q, Q > 0, T e = r c I nxn G IR nxn , T CT = r w = r c are adaptation gains with 
T c £ K + . In the implementation of the projection operator we use the compact 
sets © as given in while we replace Ao, 0,q by larger sets A and U = [u>i, u u ] 
such that 

A < A, < LOi < LO k} < LO Uo < LU U . (7) 

The purpose of this will be shortly clarified in the analysis of the stability mar- 
gins. 

Control Law: The control signal is generated through gain feedback of the 
following system: 



X{s) = D(s)r u (s) , u(s) = -kx{s) , 



(8) 
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where r n (s) is the Laplace transformation of r u (t) = Cj{t)u(t) + r(t), k € IR + is 
a feedback gain, f(t) = 9 T (t)x(t) + &(t) — k„r{t), k„ = — T , and D{s) is a 
LTI system that needs to be chosen to ensure 

is stable and strictly proper with C(0) = 1. One choice is D{s) = -, that leads 
to C(s) = s +^ k . Let L = maxgge Ya=1 1^1- We now §i ye tne performance 
requirement that ensures desired transient performance, [1]. 

£i-gain stability requirement: Design D(s) to ensure that C(s) in © satis- 
fies 

||G( S )|| A L<1, (10) 

where G(s) = H(s)(l - C(s)), and i?(s) = (si - A m )~ l b . 

The complete C\ adaptive controller consists of (|5J, (Fj3l subject to dTOt . 

We notice that the £i-gain stability requirement depends only upon the choice of 
G and is independent of the choice of Aq, or A, 17. 



5 Analysis of C L Adaptive Controller 

Next, consider the following closed-loop reference system with the control signal 
u re f(t) and the system response x re f(t), the stability of which, subject to (110b . can 
be proven using the small-gain theorem, [1]: 

it) = A (t) + b{oju ref {t) + 6 T x ref (t) + a(t)) 

Uref(s) = C(s) Tref ^ , y ref (t) = C T X ref (t) , (11) 

with x re f(0) = xq, where f re f(s) is the Laplace transformation of the signal 

r re f = -8 T x ref (t) - a(t) + k g r(t). 

Lemma 5: [1] For the system in (QJ and the C\ adaptive controller in (FJl, (|4]i-(|6j 
and <TJ>, we have ||£ || £oo < J Xm £{p)r c where ° m ~ max 0ee E"=i 46 f + 4a2 + 

Lemma ensures existence of c D € IR n such that cj H(s) = , where the 
order of A^(s) is one more than the order of N n (s), and both N n (s) and A^(s) are 
stable polynomials. 
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Theorem 1 : [1] Given the system in (Q and the C\ adaptive controller defined 
via ©, ©-© and © subject to ( flTJt . we have: \\x — aVe/lkoo < 7i, \\u — 

UrefWc^ < 72, wher e 7i = J| gg|^ L yZg^T, and 72 = ||^0 T ||a7i + 

C(s) 1 T / 9 m 

w cjH(s) C ° £l V A max (P)r c " 

6 Time-delay Margin Analysis 

6.1 £1 adaptive controller in the presence of time-delay 

To analyze the time-delay margin of the closed-loop adaptive system in the next 
section we consider a linear time-invariant (LTI) system subject to an external ex- 
ogenous input. We develop sufficient conditions under which that LTI system can 
be used to evaluate the time-delay margin of the closed-loop adaptive system. Be- 
fore then, we need to introduce the following three systems. 
System 1. We rewrite the open-loop system in Q as 

x(s) = H(s)(uu(s) + a(s)) , (12) 

where H(s) = (si — A m — b6~ [ )~ 1 b. Without loss of generality, we set: 

x(0) = 0. (13) 

Let Xd(t) be the delayed signal of the open-loop state x(t) by a constant time 
interval r, i.e 

We close the loop of (fT2l with C\ adaptive controller ©, I©-©, (fJJ, using x<i(t) 
from (fT4b instead of x(t) everywhere in the definition of ©, ©-(EDl, ©• We 
denote the resulting control and state trajectories of this closed-loop system by u(t) 
and Xd(t). We further notice that this closed-loop adaptive system has a unique 
solution. It is the stability of this closed-loop system that we are investigating in 
this paper, dependent upon r. It is important to point out that while applying the 
L\ adaptive controller (fJJ, (fJl to the system in (fT2t using x^(t) from dl4l . 

one cannot derive the dynamics of the error signal between the system state and 
the companion model, the boundedness of which is stated in Lemma |5] Neither 
Theorem ^is valid. 

System 2. Next, we consider the following closed-loop system with the same 
zero initial conditions: 

x q (t) = A m x q {t) + b (uu g (t) + 9 T x q {t) + a(t) + 7?(i)) , (15) 
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where x q (0) = x(0), 9 and a(t) have been introduced in (Q, u q (t) is defined via 
©, (HJ-© and while 77(f) is a continuously differentiable bounded signal with 
uniformly bounded derivative. As compared to Q or ill 2b . the system in (fT5l has 
one more additional disturbance signal 77(f). If 

|a(f) + 77(f)| < A, (16) 

where A has been defined in @, then application of C\ adaptive controller to the 
system in (fT3l is well defined, and hence the results of Theorem^are valid for the 
system in (fT5l as well. We denote by u q (t) the time trajectory of the C\ adaptive 
controller, resulting from its application to (fT5l . 

System 3. Finally, we consider the open-loop system in (fT2T >- dl4l > and apply 
u q (t) to it and look at its delayed output x (t), where the subindex o is added to 
indicate the open-loop nature of this signal. It is important to notice that at this 
point we view u q (t) as a time- varying input signal for dT2l . and not as a feedback 
signal, so that (fT2l remains an open-loop system in this context. 

Illustration of these last two systems is given in Fig. ^ 



Fig. 1 : Systems 2 and 3 



Lemma 6: If the time-delayed output of the open-loop System 3 has the same 
time history as the closed-loop output of System 2, i.e. 

x (t) = x q (t), Vf >0, (17) 

then u(t) = u q (t), Xd(t) = x q (t), V t > 0, where it(f) and x^(f) denote 
the control and state trajectories of the closed-loop System 1 in (fT2T >- dl4b with C\ 
adaptive controller. 
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Proof. It follows from (fTTb that the open-loop time-delayed System 3 in (Tl2t - (ll4t 

generates x q (t) in response to the input u g (t). When applied to ( fT5l . u q {t) leads 
to x q (t). Hence, u q (t) and x q (t) are also solutions of the closed-loop adaptive 
System 1 in O-fli with ©, <TJ>. □ 

This Lemma consequently implies that to ensure stability of the System 1 in 
the presence of a given time-delay r, it is sufficient to prove existence of 77(f) in 
System 2, satisfying (fToT) and verifying (fT7t . We notice, however, that the closed- 
loop System 2 is a nonlinear system due to the nonlinear adaptive laws, so that the 
proof on existence of such 77(f) for this system and explicit construction of the set 
A is not straightforward. Moreover, we note that the condition in (TfTb relates the 
time-delay r of System 1 (or System 3) to the signal 77(f) implicitly. In the next 
section of this paper we introduce an equivalent LTI system that helps to prove 
existence of such 77(f) and leads to explicit construction of A. Definition of this 
LTI system is the key step in the overall analysis. It has an exogenous input that 
lumps the time trajectories of the nonlinear elements of the closed-loop System 
2. For this LTI system, the time delay margin can be computed via its open-loop 
transfer function, which consequently defines a conservative lower bound for the 
time-delay margin of the adaptive system. 

6.2 LTI System in the Presence of Time-delay in its Output 

Consider the following closed-loop LTI system: 

Xl (s) = H(s)Ci(s), e,(s) = (C(s)/w)f,(s) 

Ul (s) = (l/u)C(s)(k g r(s) - d T Xl (s) - a(s) - Vl (s)) - e,(s) 

where d(s) = uui(s) + a(s), Tji(s) = Q(s) — uiui(s) — a(s), r(s) and a(s) are the 
Laplace transformations of the bounded signals r(f) and cr(f), respectively, x;(f), 
ui(t) and e;(f) are selected states, Q(t) is its output signal, and 77(5) is the Laplace 
transformation of an exogenous signal n(f). We note that the system trajectories 
are uniquely defined once f; (f ) is given. 

We notice that the transfer functions from <r(f) and r(f) to xi(t) are the same 
as in the reference system. Since xi(s) = H(s)(i(s), we have 

Xl (s)/r(s) = (H{s)C(s))/{\ + C(s)6 T H(s)) , (18) 
xi(s)/a(s) = (H(s)(l - C(s)))/(l + C(s)e T H(s)) . (19) 

One can verify that for the reference system in (fTTT) . we have x re f(s)/r(s) and 
x re f(s)/a(s) equivalent to (fT8l and ( fl9l . We also notice that the LTI system with- 
out time-delay ensures stable transfer functions from inputs r(f), <r(f) and f;(f) to 
output Q(t). 
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Assume the system output Q(t) experiences time-delay r, so that in the pres- 
ence of the time-delay we have: 

Xl (s) =B(s)( ld (s) (20) 

Ui(s) =(C(s)/u)(k 3 r(s)-9 T x l (s)-a(s)-r U (s))-e l (s) (21) 

e,(a) = (C(s)/u)n(s) (22) 
(i(s) = ujui(s) + cr(s) , (23) 

where (i d (t) is the time-delayed signal of i.e 

consequently leading to redefined r]i(s): 

Vl( s ) = Cl d ( s ) -uui{s) - a(s). (25) 

Let 

x/(0)=0, ^(0) = 0, e/(0) = 0. (26) 

We notice that the system in d20l - d23l is highly coupled. Its diagram is plotted in 
Figure |2] 



Fig. 2: LTI system 



6.3 Time-Delay Margin of the LTI System 

We notice that the phase margin of this LTI system can be determined by its open- 
loop transfer function from C,i d {t) to (i(t). It follows from d20t . (T2TT) . and d25l 
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that umi(a) = CW ^ 9r(s) -^ (s 1 ) ;^f (s) ^ (5) )"" £ ' (s) , and hence © implies that 

C(s)(k g r(s)-Ci d ( S )-e T i?( S )Ci d («))-«e,(<) , . 

Q(sJ = — ^l 5 )- Therefore, it can be equiv- 

alently written as: 

Ci(s) = Tn^y ( r f>( s ) ~ r /( s )) ' 

r f (s) = C(s)(l + 6 T H(s))( ld ( S ), (27) 
r b (s) = C(s)k g r(s) + (l-C(s))a(s)-uje l (s). 

Assume that f;(£) is such that ej(i) is bounded. Since a(t) and r(t) are bounded, 
C(s) is strictly proper and stable, then r b {t) is also bounded. The block-diagram 
of the closed-loop system in d27l is shown in Figure |3] 



Fig. 3: LTI system 



The open-loop transfer function of the system in d27T i is: 

H (s) = C{s){l + e T H(s))/(l - C(s)) , (28) 

the phase margin V(H (s)) of which can be derived from its Bode plot easily. Its 
time-delay margin is given by: 

T(H (s))=V(H (s))/lo c , (29) 

where V(H (sj) is the phase margin of the open-loop system H a (s), and lo c is 
the cross-over frequency of H Q (s). The next lemma states sufficient condition for 
boundedness of all the states in the system d20l - (l23b . including the internal states. 

Lemma 7: Let 

r < T(H (s)) (30) 

and €b be any positive number such that He/H^ < e&. Then the signals Q{t), xi(t), 
ui(t), r)i(t) are bounded. 
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Proof: Since ej(i) is bounded and r < T(H (s)), then boundedness of Q(t) 
follows from definition of T{H Q {s)). Boundedness of (,i d (t) follows from its def- 
inition in d24l . Since Q(t) and a(t) are bounded, it follows from d23l that ui(t) 
is bounded, and implies boundedness of rji(t). Notice that since ui(t) and 
ei(t) are bounded, it follows from d2"Tl that 6 T xi(t) is bounded. We notice that 
Xi(s) in d20t can be written as xi(s) = H(s)(6 T X[(s) + Q d (s)), which leads to 
boundedness of xi(t). □ 
For any r < T(H (s)) and any ej > 0, Lemma guarantees that the map 
A n : R+ x [0,T(# o (a)))'->m+ ' 

A n (e fe ,r) = max ||cr + ^|| £oo (31) 

is well defined. We note that strictly speaking rji(t) depends not only on e/(i) and 
r, but also upon other arguments, like a(t) and other variables of the system that 
are used for definition of r#(t). These are dropped due to their non-crucial role in 
the subsequent analysis. 

Lemma 8: Let r comply with d30l . and be any positive number. If fj(i) is such 
that the resulting ei(t) is bounded 

Ihlkoc < £fe , (32) 

and 

2uj\\ Ui \\ Coo + 2L||x i || £oo + 2A > WnWc^ , (33) 

where 

A = A n (e b ,T)+S 1 , (34) 

Si is arbitrary positive constant, then rji(t) is differentiable and the Coo norm of 
rji(t) is finite. 

Proof: It follows from d32l and LemmaQthat xi(t), ui(t), A n (e&, r) are bounded. 
Hence, it follows from d33l that f/(t) is also bounded. Since C(s) is strictly proper 
and stable, bounded f / (i) ensures that e\ (t) is differentiable with bounded deriva- 
tive. Using similar methods, we prove that both ui(t) and d (*) nave bounded 
derivatives. Since &(t) is bounded, it follows from d25l that rji(t) is bounded. □ 
For any r < T{H {s)) and any > 0, Lemma[8]guarantees that the following 
map A d : IR+ x [0,T{H o (s))) H+ 

Ad(e 6 ,r) = max||o- + ?)i||£ 00 (35) 
n(t) 
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is well defined, where f;(i) complies with d32l and d33l . Further, let 



m (e b ,r) 4 maxV4fl t 2 + 4A 2 + 4K 



i=i 



e c (e b ,T) 



+2A max (P)A d (e 6 , r)A/A min (Q) , 
C(s)- 



/ Qm{tb,T) 

cjH( S y° aV A max (P) e 2 



(36) 
(37) 



We notice that for any finite e b £ K + and any r verifying d30b . we have finite 
A n (e&, t) and Ad(e b , r), and hence finite e c (e b , t), if f$(t) complies with i32l and 
d33l. 



6.4 Time-delay Margin of the Closed-loop Adaptive System 

In this section we analyze the time-delay margin for the closed-loop adaptive sys- 
tem with the C\ adaptive controller. The main result is given by the following 
theorem. 

Theorem 2: Consider the closed-loop adaptive system, comprised of System 1 in 
(TJUi-ClUi with ©, (Hi-©, (EJ and the LTI system in d20j-(I^Sl> in the presence of 
the same time delay r. For any e b € IR + choose the set A as in d34l > and 

T c > y/e c (e b ,r) + 5 2 , (38) 

where 62 is arbitrary positive constant. Then for every r satisfying r < T(H (s)), 
there exists exogenous signal 77 (i) ensuring ||ei II^Coo < e b > m & 

xi(t) = x d (t) , ui(t) = u(t) , Vt > . (39) 

The proof of this Theorem is given in the Appendix. Theorem |2] establishes the 
equivalence of state and control trajectories of the closed-loop adaptive system and 
the LTI system in d20b - <l23l> in the presence of the same time-delay. Therefore the 
time-delay margin of the system in d20t - (l23t can be used as a conservative lower 
bound for the time-delay margin of the closed-loop adaptive system. 

Corollary 2: Given the system in ([B and the C\ adaptive controller defined via 
©, ©-(|6j and © subject to (fTOt . where r c and A are large enough, the closed- 
loop adaptive system is stable in the presence of time delay r in its output if r < 
T(H (s)) , where T(H (s)) is defined in 

The proof of Corollary IJJfollows from LemmaQand Theorem Indirectly. 
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7 Gain Margin Analysis 

We now analyze the gain margin of the system in Q with C\ adaptive controller. 
By inserting a gain module g into the control loop, the system in (Q can be formu- 
lated as: 

x(t) = A m x(t) + b (uj g u{t) + 6 T (t)x(t) + <r(tj\ , (40) 

where u: g = gu. We note that this transformation implies that the set SI in the ap- 
plication of the Projection operator for adaptive laws needs to increase accordingly. 
However, increased Q, will not violate the stability criterion. Thus, it follows from 
(0 that the gain margin of the C\ adaptive controller is determined by: 

ffm = [Wi/Wj , UJ U /UJ U0 }. (41) 

If g € Qm , then the closed-loop system in d40t satisfies the C\ stability criterion, 
implying that the entire closed-loop system is stable. We note that the lower-bound 
of Q m is greater than zero. Eq. (RTt implies that arbitrary gain margin can be 
obtained through appropriate choice of Q. 



8 Main Results 

Combining the results of Theorem^ and Theorems of Sections l631 andl71 we have 
the following results: 

Theorem 3: Given the system in Q and the L\ adaptive controller defined via 
(01, (|4]i-(|6j and © subject to (fTOl) . we have: 

lim (x(t) - x re f(t)) = , Vt > 0, (42) 

r c ^oo 

lim (u(t) - u ref (t)) = , Vt > , (43) 

r c ^oo 

lim T>T{H (s)), g^Gm, (44) 

r c -»oo 

where T and Q are the time-delay and gain margins of the C\ adaptive controller, 
while T (H (s)), Q m are defined in <H0 and (HTV 

The inequalities in d44l imply that T(H (s)) and Q m are just conservative bounds 
of the stability margins. 
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9 Simulations 



We consider the same system from [1], in which a single-link robot arm is rotating 
on a vertical plane. Assuming constant 9{t), it can be cast into the form in (0 



with A r 







-1 



1 

-1.4 



1 





. Let 



[2 2]" 



1, a(t) = sin(7ri) , so that the compact sets can be conservatively chosen as fio = 
[0.2, 5], 9 = [-10, 10], A = [-10, 10] , respectively. Next, we analyze the 
stability margins of the C\ adaptive controller for this system numerically. 



Gm = -30.5 dB (al 1 .23 rad/sec) , Pm - 




Frequency (rad/sec) 



Fig. 4: Bode plot of H (s) for 9 = [2 2] T , uj = 1 



For 9 = [2 2} 



u 



1 we can derive H a (s) in d28t and look at its Bode plot 



inFig.|4] It has phase margin 88.1°(1.54rad) at cross frequency 9.55Hz(60rad/s). 
Hence, the time-delay margin can be derived from d29t as: T(H (s)) = gfrad/s = 
0.0256. We set A = [-1000 1000] T , T c = 500000 , and run the C x adaptive 
controller with time-delay r = 0.02. The simulations in Figs. |5(a)|5(b)] verify 
Corollary |2] As stated in Theorem |3j the time-delay margin of the LTI system in 
(128 ll provides only a conservative lower bound for the time-delay margin of the 
closed-loop adaptive system. So, we simulate the L\ adaptive controller in the 
presence of larger time-delay, like r = 0.1 sec, and observe that the system is 
not losing its stability. Since and u are unknown to the controller, we derive the 
T(H (s)) for all possible 9 G and u G $7 and use the most conservative value. 
It gives T(H (s)) = 0.005s. The gain margin can be arbitrarily large as stated in 
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10 Conclusion 

In this paper, we derive the stability margins of L\ adaptive controller presented 
in [1]. To the best of our knowledge, this is the first attempt to quantify the time- 
delay margin for general closed-loop adaptive systems. With the particular archi- 
tecture presented in this paper, we prove that increasing the adaptive gain leads 
to improved transient tracking with improved stability margins. This presents a 
significant improvement over conventional adaptive control schemes, in which in- 
creasing the adaptive gain leads to reduced tolerance to time-delay in input/output 
channels. 




(a) x'i(t) (solid), x\(t) (dashed), and 
r(i)(dotted) 




(b) Time-history of u(t) 
Fig. 5: Performance of C\ adaptive controller with time-delay 0.02s 
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Appendix 

Proof of Theorem |5J In the closed-loop adaptive system in ( 1151 for any t > 0, we notice 
that if || (a + ??)t||£ 00 < A , and &(t), rj(t) have finite derivatives over [0, t], then appli- 
cation of Ci adaptive controller from [1] is well-defined. Let d t denote the truncated 
norm 



dt = \\(& + fl)t\\c 00 - (45) 

It follows from l|3} and dl5l that x q (s) = H(s)f(s), where x q (s) and f(s) are the Laplace 
transformations of x q (t) — x(t) — x q (t) and 

r(i) = Q(t)u q (t) + e T (t)x q (t) + a{t) . (46) 
This along with Eq. (50) in [ 1 ] implies that 

C(s) 

u g(*)te[o,t] = S{ , u q (0), (k g r(t) - T x q {t) - 

x q {t) tem = S{H{s),x q (0),r(t) te[0tt) ), (47) 
where a(t) = a(t) — (a(t) + r)(t)). Equation d47l implies that 

u q {t) tem - S(^,u q {0), (k g r(t)-0 T x q (t)- 

<r(t)-v(t))te[o,t))-e(t)te[o,t], (48) 

where 

e(t) te[0tt ] =S(C(s)/u,0,r(t) t&m ). (49) 

We further define 



9 t 4 maxV AB\ + maxAa 2 + 4 (ui u - uji) 2 + 2 ' na *vJ rf t A , (50) 
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where d t is defined in ( 145 1 . It can be verified easily that Lemma [5] holds for truncated 
norms as well so that |j£ g J £oc < J x % )Vc • Since e(s) = „°%\ s) cjH(s)? (s) = 



n (P)r c - — ujcJh{s) 1 



C ^ ) cjx q (s) , then e(t) can be upper bounded as 



C{s) u>cjH(sf° . 



(51) 



In the three steps below, we prove the existence of a continuously differentiable r)(t) 
with uniformly bounded derivative in the closed-loop adaptive system H5\ . (0, (@}-(|6}, (|8} 
and the existence of ri (t) in time-delayed LTI system such that for any t > 0, 

\a(t)+r)(t)\<A,x (t)=x q (t), (52) 

IN* lUoo < e b , 2Cj(*) = x q{t)l U l( l ) = u g ^(t) = • (53) 

With d52i . Lemma [6] implies that Xd(t) = x q (t),u(t) — u q (t) for any t > 0, which 
combining (1531 proves Theorem|2] 
Step 1: Let 

C(t)=w«,(t) +(r(t). (54) 

We further define 

Cd - \ C(* - r) , i > r ■ (55) 

Since (ITU and dl4t imply that 5G (i) = for any t <E [0, r], it follows from (BBl and the 
definition of the map <S that x (*)|te[o.r] = <5 (H(s), x o (0), Cd(*)te[o,r)) ■ F° r i > 1, it 
follows from the definition of the time-delayed open-loop system that 

x o{t)\t&[iT,(i+i)r] = S {H(s),x (iT),(d(t)te[iT,(i+i)T)) • (56) 

Hence, d56l holds for any i. We note that ( I49> implies that e(0) = . These along with 
O. Gl, GS, B imply that for i = 

« g (ir) = ui(iT),e(ir) = ei(ir), x {it) = x q (ir) = xi(ir) , 

Ut) = bAt),t<(i + l)T, |e(t)|<e 6 , t<ir. 

Step 2: Assume that for any i the following conditions hold: 

u q (t) =ui(t), t<ir, (57) 

e(t) = ej(t), i = ir, (58) 

s (t) =i,(t)=x I (t), i<ir, (59) 

&(*) = Cw(<) .Vie [tV, (i + l)r) , (60) 

|e(i)| < eb, Vt< ir. (61) 

For i > 1, further assume that there exist bounded and continuously differentiable 
7/(i) with bounded derivative over t e [0, ir) such that V t < it 

r,(t)= m (t), \<r(t) + r)(t)\ < A . (62) 
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We prove below that there exist bounded ri(t) and continuously differentiable r)(t) with 
bounded derivative over t G [0, (i + l)r) such that ( I57t -d62t hold for i + 1, too. 
We note that d20t implies that 

xi(t)\te[iT.(i+i)r] = S (H(s),xi(iT),(i d (t)te[iT,(i+i)T)) ■ (63) 
Using (|59>-(|60j, it follows from <|56) and O that 

x {t) =xi(t), Vte [it, (i + 1)t] . (64) 

We assumed in (I62> that if i > 1, then there exists r){t) over [0, it). We now define r/(i) 
over [ir, (i + 1)t) as: 

V(t) = Cd(t) - wu,(t) - o-(i) , t e [ir, (i + l)r) . (65) 

Since O implies that x q (t)\ te[iT ^ l+1)T] = S{H{s), x q (iT)(uJu q (t)+<T(t)+?](t)) te[lT ^ +1)T) ), 
it follows from (|63 that x g (i)|i e[ir! ( i+1)r ] = S(H(s), x q (iT), Crf(*)te[iT,(i+i)r))- Along 
with J56I and (1591 this ensures that 

x q (t) = x a (t), Vt e [*t, (i + 1)t] . (66) 
However, the definition in ( 1651 does not guarantee 

< A, te + l)r), (67) 

which is required for application of C\ adaptive controller. 

We prove (167 \ by contradiction. Since rj(t) is continuous over [ir, (i + l)r), if J67i is 
not true, there must exist t' £ [ir, (i + l)r) such that 

\a(t)+r](t)\ < A, Vt<t', (68) 
|cr(t') +r?(t') | = A. (69) 



It follows from d56i and d65i that x (t) t £[i T ,t'] = <S( H(s), x {it), (u>u q (t) + a(t) + 
7 ?(*))te[ir,t'))- i,; follows from <EH} and 63 tnat 

u q(t)\t£[iT,t'] = s(^-^-,u q (iT) + e(ir), (fc a r(t) - 9 T x q (t) 

-Cr(t) - ??(t))tG[iT,t')) ~ £ (0ltG[4r,t'] , (70) 



where 



e (*)lte[iT,t'] = sfc(s)/w,e(ir),f(t) te [ iTi4 ,)) . (71) 
We notice that if i > 1, then on [0, ir) we have well defined. Let 

f;(t) = f(t), t€[iT,t'). (72) 
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We have ei\t£[i T ,t'\ — S\C(s)/uj,ei(iT),r{t) t ^ iTA i)j, which along with d58l and fTA 
imply that 

e,(t)=e(t), V*G[iT,^. (73) 
Hence, (E), EJ, @, O yield 

%(*)|te[jT,t'] = S[C(s)/uj,ui(iT) + e(ir), (fc ff r(i) 

-0 T x,(t) -er(i) -r?(t))te[ir,t')) - e(*)|te[ir,t'] ■ (74) 

It follows from {73) and ((74) that 

««(*)|te[iT,t'] = s(c(s)/uj,ui(iT) + ei(iT),{k g r(i) 

-6 T xi(t) -a{t) -T)(t))teliT,r)) ~ ei(*)lt€[tr,f] • (75) 

It follows from (|23} and that 

r?/(t) = (d(t) - wui(t) - <r(t) , i G [it, i'] , (76) 

which along with (12 1 i yields 

w/(*)|te[*r,f] = 5 ( ,«i(* r ) +ei(iT),(k g r(t) 

-0 T xi(t) - a(t) - m (t)) te[ir ^ -ei(*)lt 6 [*r,f]- (77) 

From d65l >. d75i . ( I76> and ( I77> . we have 

u,(i) = ui{t), Vi G [it, t'] (78) 
»?(*) = »»(*), V*e[*r, 0- (79) 

It follows from (|62j and (|79j that 

7](t) = m (t), Vte[0,t'). (80) 

We now prove by contradiction that 

|e(t)| < e b , Vi £ [iT,t'\. (81) 

If (18 1 1 is not true, then since e(t) is continuous, there exists some t G [it, t'] such that 

|e(t)| < 66, VtG[iT,t), (82) 

|e(t)| = e 6 - (83) 

It follows from do*H that 

|e(t)|<£6, V[0,t|. (84) 
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It follows from {59jl, (|64j, (|66|l and (dJl that it g (i) = u z (t) , x 9 (f ) = x t (t) for any 
i G [0,i], Therefore, g5} and {7JJ imply that fj(i) = u>(t)u;(t) + 6 T {t)xi{t) + a(t), and 
hence 

|[fl r IU. < 2o;|K-|| £oo +L|K-|| £oo +2A. (85) 

From J84i and (1851 . Lemmas and [8] imply that r)i(t) is bounded and differentiable with 
bounded derivative. Further, it follows from A3 1 1 and d35t that 



\<r(t)+rn(t)\ < A„(e 6 ,T), VtG[0,t], 
|<r(t)+7ji(t)| < A d (e 6 ,r), VtG[0,t]. 



(86) 



Since d80t holds, r](t) is also bounded and differentiable with bounded derivative over 
\0,t') and further 



\a(t) 
\a(t) 

It follows from (JH) that 



■r)(t)\ < A n (e 6 ,r), 
#)| < A d (e 6 ,r), 



Vte [0,t\, 
Vi e [0, t\ . 



(87) 
(88) 



mco 



< 



C(s) 



It follows from (J36J, (|50j and (gill that 



£1 y ^min 



< 



(eb,T). 



Hence, (|5TJ and (|90) imply that ||e f ||£ 

and(l38t we have ||et Hz:^ < £b, which contradicts J83I . Therefore, (18 1 1 holds 
If d8Tl is true, it follows from doTl that 



(89) 

(90) 
From 03 



(91) 



(92) 



\e(t)\ <e b , Vf G [0,tf]. 
Hence, it follows from J3 1 1 and (I80i that 

|cr(t) +77(*)l < A„ < A, 
which contradicts d69i . Hence, we have 

\a(t)+T](t)\ < A, Wt £ [ir,(i+ l)r]. 

Therefore, combining {64}, (|66j, (|73j, (|78}, l|79}, <ED, <|92j, we proved that there exist 
fiit) and continuously differentiable r/(t) in [0, (i + l)r), which ensures 

X (t) = X q (t)=Xl(t),Vt£[iT,(i + l)T], (93) 

e(t) = c,(*). V* G [ir,(i + l)r], (94) 

= ^(f), Vi G [ir,(i + l)r], (95) 

= T/j(t), Vte[ir,(i + l)r), (96) 

< e b , Vf G [0,(i+l)r], (97) 

< A, Vt G [0,(i + l)r]. (98) 



»?(*) 

k(*)l 
k(*)+»7(t)l 
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It follows from J23), l|54} and <|95} that 

C(*) = Cl(*)» Vte[ir,(i + 1)T). 
Therefore ( 1241 and d55t imply that 

Cd(t) =Ct*(«), Vt€[(i + l)r,(i + 2)r). (99) 

We note that Step 2 is proved in (I93l-d99l for i + 1. 

Sfep 3: Step 1 implies that the relationships 1571 -1611 hold for i = 0. By iterating the 
results from Step 2, we prove (I52M53> . which conclude proof of the Theorem. □ 



